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ABSTRACT 


This study was designed to examine the effects of counsellor-— 
selection (evaluation) as opposed to client or self-selection (nonevalu- 
ation) within the context of the required counselling interview. Former 
Students who were applying for readmission to university after having 
failed a year were assigned to one of two treatment groups (evaluation 
and nonevaluation) and to one of four counsellors. 

In the evaluation treatment subjects were tested, then interviewed 
by a counsellor. On the basis of the interview, test results and other 
material available the counsellor was required to make a written recom 
mendation to the administration concerning the client's chances for 
Success. 

In the nonevaluation treatment the subjects received the same test 
battery and were interviewed by a counsellor. However, in this treatment 
there was no counsellor recommendation. Instead, the onus for selecting 
whether or not the subject was to return to university rested with the 
subject. 

All of the interviews (N = 99) were recorded and independent judges 
rated empathy, confrontation and client depth of self-exploration accord- 
ing to instruments developed by Carkhuff (1969). Subjects also completed 
the Counselling Evaluation Inventory. 

Directional hypotheses consistent with the client-centered position 
were stated. It was expected that counsellor empathy and client depth of 
self-exploration would be higher under the nonevaluative rather than the 
evaluative treatment. In addition, client ratings on the Counselling 
Evaluation Inventory should be more positive for the nonevaluation con- 


dition. A nondirectional hypothesis for confrontation was also stated. 
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With respect to empathy, confrontation, client self-exploration 
and the Counselling Climate Factor of the Counselling Evaluation 
Inventory there was no difference between the two treatment groups. 
There was, however, a significant difference between the two institu- 
tional treatments (nonevaluation> evaluation) on the Client Satisfaction 
Factor of the Counselling Evaluation Inventory. 

While methodological problems cast a ee over all the findings, 
there was very little support for the client=centered position that 
evaluation per se produces a negative atmosphere within the counselling 
interview. On the other hand, subjects seemed to feel more comfortable 
and satisfied with the nonevaluative treatment. The overall effects of 
this finding are not straightforward and further empirical clarification 


was suggested. 
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CHAPTER I 


INTRODUCTION 


Since its introduction into North America at about the pais eal 
the century, applied psychology has been tied to the evaluative enter- 
prise, including testing, diagnosis and personnel selection. Before 
World War II applied psychologists were primarily cape iee ie che age 
sessment of intelligence and psychological diagnosis, in support of 
Peehiatric treatment programs (Reisman, 1966). The use of intellec~ 
tual, personality, and vocational tests were considered toebe the ex~_ 
clusive domain of psychologists (Sundberg, Tyler, & Taplin, 1973). 

During World War II hardly an adult male of military potentiality 
escaped psychological testing (Reisman, 1966). Psychologists were in- 
volved in numerous projects; for example, the testing and screening 
ef candidates for the Office of Strategic Services (OSS) and the se-~ 
lection and training of pilots, officer candidates, and skilled sup~- 
port personnel (navigators, radar repairmen, etc.). 

After the War psychologists moved eae eae programs that 
had nee previously restricted to medical personnel, because there 
ERE not enough trained medical staff to deal with the psychi- 
BELL eee involved in rehabilitating veterans, and because voca~ 
tional rehabilitation and counselling were not relevant to the medical 
enterprise. Thus, psychologists functioned as both diagnosticians and 
therapists. The "baby boom" right after the War caused an enormous 
expansion in the field of er ee and there was a consequent growth 


in counselling psychology. 


During the 1950's psychological assessment was rapidly expanding. 
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If there were doubts about the appropriateness and usefulness of psy~ 
chological assessment, then the public and most practitioners did not 
express them (Sundberg, Tyler, & Taplin, 1973). However, in the late 
fifties and early sixties psychological assessment came under a ereat 
deal of public and professional criticism. Four books spearheaded the 
attack: The Organization Man (Whyte, 1956), The Myth of Mental I1l- 
ness “(Szaz, 1961); The Brainwatchers (Gross, 1962), and The Tyranny 
of Testing (Hoffmann, 1962). The issues were not always clearly dif- 
ferentiated from one another, but at least four primary areas of con- 
cern have been articulated: (1) Discrimination with respect to minor- 
ity groups and socioeconomic class. (2) Lack of validity; i.e., that 
psychological tests do not measure what they proport to measure and 
that many selection processes are not effective screening mechanisms. 
(3) Invasion of privacy. (4) Aiding conformity; i.e., the range of 
talents in most selection processes are limited to easily identifiable 
characteristics and often unique but capable individuals are denied 
access because they don't match the evaluator's list of characteris- 
tics. 

The criticisms concerning validity and discrimination are often 
linked. If evaluators and their instruments of appraisal are divin~ 
ing actual talents, then discrimination per se is the purpose of eval- 
uation. However, if the instruments and/or processes of evaluation 
are invalid or of questionable validity, then the likelihood of unfair 
discrimination obviously increases. Many of the areas of assessment 
(diagnosis, personnel selection and predicting academic success) seem 
to fall into the gray areas of questionable validity (Dailey, Lod ea 


Critics claim that the instruments used and/or devised by psychol- 
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ogists and the processes of evaluation unfairly discriminate against 
minority groups and lower socioeconomic classes. This occurs because 
they are based on attitudes, values and experiences which are not com 
mon to these groups (Gardner, 19613 Dailey, 1971). Thus, the instru-~ 
ments and processes of evaluation are pictured by their critics as 
both ineffective and prejudicial--they do not predict and they perpet- 
uate social injustice. 

As noted, there have been criticisms aimed at the validity of 
psychological evaluation. These criticisms range from a lack of cor- 
relation between diagnosis and treatment (Szaz, 1961), to the inabil- 
ity of school counsellors to predict academic success (Watley, 1967). 
Holt (1967) has presented impressive data to support his conclusion 
thate'diachostic testing dshinoa«state! of fink" «(pen444). ))Kaplin; 
Colarelli, Gross, Leventhal, and Segal (1970) concluded that psycho- 
logical evaluation has undergone diminishing emphasis in professional 
meetings, publications and graduate programs because of a lack of sci- 
entific validity. Meehl (1954) and many others have often demonstrated 
the overall supremacy of actuarial as opposed to clinical predictions. 
Finally, Sundberg, Tyler, and Taplin (1973) have suggested that the 
recent changes in employment patterns within the profession of clin- 
ical psychology have been to a large extent the results of a de~empha~ 
sis and dropping of outmoded assessment practices. 

Brim (1965) and Neulinger (1966) conducted surveys of the pub- 
lic's attitude towards psychological testing. Brim (1965) found that 
most of those surveyed felt they had the right to withhold information 
of personal nature from their employers. Furthermore, the publics ex 


pressed concern that psychological screening should be limited to task 
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relevant material (Neulinger, 1966). Most of those surveyed also ex- 
pressed concern that material of a personal nature contained within 
files could somehow be used against them (Brim, 1965). From within 
the profession both Gross (1962), Whyte (1954), and many others have 
strongly argued against the use of personality and projective tests as 
instruments of appraisal for educational and occupational decision 
making. Both of these authors felt that the "rights" of the individ- 
uals had been violated by the misuses of psychological tests. 

Personality tests used in personnel selection have been blamed 
for producing conformity. The criticism was first popularized by 
Whyte's The Organization Man (1956). In brief, the evaluation enter- 
prise has been criticized for limiting the horizons of society by 
screening from the upper echelons creative but eccentric individuals 
and substituting for them less talented but more socially acceptable 
types (Whyte, 1956; Gross, 1962). 

The issues raised by these criticisms are extremely complex, con- 
tentious and to a large extent generally unresolved. These criticisms 
have, however, forced a reexamination of the evaluation enterprise in 
clinical psychology (Sundberg, Tyler, & Taplin, 1973) and in education- 
al, corporate and governmental personnel selection and management 
(Dailey, 1971). In addition to the above concerns, some comments with 
respect to psychologist's less obvious involvement in institutional 
decision making would seem to be in order. 

Essentially, most institutional decision making (governmental, 
corporate and educational) is based upon credentials such as age, ver- 
bal aptitude, sex, grade point average, outgoingness, management ori- 


entation, etc. Access to desirable goals, such as promotion and pro- 
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fessional membership usually depends upon a gatekeeper (administrator) 
evaluating candidates on the basis of their credentials and a reward- 
ing (approving access) to those with the proper credentials, while 
withholding gratification (denying access) for the unqualified. Es- 
sentially, psychologists in a great many settings help to determine 
the criterion for judging credentials. In many cases they do not act 
directly as gatekeepers. Instead, they often design and initiate pro- 
grams, then relinquish control of these programs to the institutional 
client. Thus, it is possible for a relatively small number of psy~ 
chologists to effect the lives of a great many people. 

Critics of the psychologist"s role in these procedures seem to 
feel that most psychologists mistakenly assume that government and cor- 
porate institutions, especially the latter, are concerned with the va- 
lidity of assessment (Dailey, 1971). This assumption has been quite 
strongly challenged by Baken (1972), May (1966), and Dailey (1971). 
They contend that most institutions are concerned with their own sur- 
vival and enhancement, and these concerns often preclude or diminish 
_ justice and/or service to the community or the individual. As govern- 
ment and corporate structures proliferate and grow larger, individual 
needs seem to be less important (Baken, 1972). Rules of conduct and 
promotion become depersonalized in the name of objectivity, and the 
end product appears to be mass alienation, tension, uncertainty, dis- 
trust, and a loss of self-esteem (May, 1966). 

Many of the above listed criticisms have their roots in so-called 
third force or humanistic psychology (e.g., Baken, 1972; May, 1966). 
Counter proposals to evaluation have been made by Rollo May (1966), 


Carl Rogers (1951), and David Baken (1972). These proposals, which 
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appear to be very general and abstract, center around the building of 
a more permissive (less evaluative) society. Perhaps as a reaction 
to a highly competitive, rule dominated western culture, stress is 
placed upon affective (emotional) rather than effective development 
(May, 1966). The present study has its roots in the spirit of zeit- 
geist of the aforementioned criticisms and is based upon assumptions 
which are more or less congruent with a nonevaluative, permissive ori- 
entation. A more detailed discussion of this position with a focus 
on counselling will be presented in Chapter II. 

The issues surrounding the evaluation enterprise have created 
divisions within the profession of psychology. In opposition to the 
humanists there is within the profession strong support for the evalu- 
ation position (Cronbach & Glesser, 1965; Meehl, 1959; Antastasi, 
1967). 

In all fairness to proponents of evaluation, such as Anastasi 
(1967) and Forehand (1971), it should be noted that in practice the 
assessment enterprise has drifted away from academic psychology. In 
everyday decision making, methodological concerns with reliability and 
validity stressed by academics often diminish and practical concerns 
take their place (Cronbach & Glesser, 1965). Thus, time and money and 
not goodness of fit appear to be the ultimate criteria for institu- 
tional decision making (Brodgen & Taylor, 1965). In sum, many of the 
criticisms aimed at the evaluation enterprise concern, in pate, ailoc. 
of methodological rigor. This deficit is most strongly condemned by 
the pro-assessment camp (Anastasi, 1967). 

Anastasi (1967) has comprehensively spoken to the above listed 


criticisms, and further recapitulation within the context would not 
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seem warranted. However, Forehand (1971) has succinctly summarized 
the utilitarian stance taken by many of the proponents of evaluation: 

A functioning society demands a wide range and diversity of 

talent, and it demands that its role be taken by persons 

who have both relevant talents and the personal qualities 

necessary for the appropriate, effective exercise for these 

talents.... If we grant such diversities, and if our so- 

ciety rejects a solution based upon hereditary and other a 

prior stratification, then the matching of persons and 

roles become a gigantic casting process, a process in which 

auditions will occur, human behavior will be assessed wise- 

ly or unwisely, validly or invalidly, with or without the 

complicity of psychological tests. (p. 534) 

In reply to criticisms of the assessment enterprise Forehand 
(1971) responds with both question and answer. "How shall we select 
and place individuals in positions assuring fairness to the individual 
and a reasonable expectation of competent performance of roles?" (p. 
536). The answer to this question appears to be in the development of 
objective and fair psychological tests and other instruments and pro-~ 
cesses of appraisal and in the competent application of them (Forehand, 
L971 3-Anastasi.,. 04967 )-« 

In brief, there exists a difference in focus between the two po- 
sitions. The anti-assessment~humanistic orientation is concerned with 
self~actualization and the affective needs of mankind. On the other 
hand, the pro-assessment utilitarians generally do not speak directly 
to the self-actualization issue nor do they emphasize the emotional 


impact of evaluation. Their primary concern is for providing fair, 
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valid selection processes, and in understanding what variables influ- 
ence these processes. 

Stott (1973) has attempted to reconcile differences between the 
evaluative and non-evaluative positions. He suggests that the tension 
between the two positions also exists within man. It is the tension 
"between survival and survival for what, between power and principal, 
between job and justice” (p. 13). 

If pressure is applied to one or both of the two positions, then 
the gap between them widens. At one end of the continuum the emphasis 
on client needs plus the questionable validity of assessment may lead 
to a refusal to evaluate one applicant against another. Extend this 
position further, and it can be argued that candidates should evalu- 
ate themselves. At the other end of the continuum stress competitive 
Selection procedures and the Spartan ethic or social Darwinism (sur- 
vival of the fittest) can be carried to an absurdity. 

At the University of Alberta there exists a prototype of the 
gate~keeping function that has been severely criticized by the anti- 
assessment position. Essentially the process, one which has never 
been empirically examined, involves the screening by Student Counsel- 
ling Services of candidates who have been required to withdraw (fail- 
ed) and are seeking readmission. These candidates are tested, then 
interviewed by a counsellor. On the basis of their academic creden~ 
tials, the interview impression, test results and any other material 
available, the counsellor makes a prognostic statement to the admin- 
istration concerning the client's chances for success. The adminis~ 


tration then makes a decision concerning the applicant's admissibil- 


ity: 
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It is intuitively obvious that there exists within this situation 
the potential for tension and/or conflict between the three parties 
involved: applicants, counsellors and administrators. This potential, 
when viewed in the light of the above discussion, seems to lead to a 
polarization of approaches with respect to readmission: evaluation 
versus nonevaluation. This study was designed to look at the effects 
of the two positions. Essentially, the question asked is what effect 
does counsellor~selection (evaluation) as opposed to self~ or client- 


selection (nonevaluation) have on a required counselling interview? 
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CHAPTER II 


REVIEW OF THE LITERATURE 


The purpose of this study is to compare evaluative and nonevalu- 
ative counselling sessions with respect to counsellor functioning (ex- 
pression of empathy and confrontation) and client functioning (self- 
exploration and perception of the interview) using clients who were 


seeking readmission to university after a previous failure. 


The Client-Centered Position 

Roger's (1942) initial nondirective approach to counselling was 
markedly different from the more evaluative and directive therapeutic 
approaches of his day. He reacted negatively to most testing and di- 
agnostic procedures because he felt that the use of these procedures 
implied.that the counsellor had answers to the client's difficulties 
which in fact he did not have. Instead of relying on testing and di- 
agnostic methods he proposed that the client, rather than the counsel- 
lor, should be responsible for his own personal growth, and that the 
counsellor should be responsible for the conditions that would allow 
the client to maximize his own resources (Rogers, 1957). 

iniciientscentered counselling, evaluation is the business of the 
client. If tests are used at all, their purpose is to help clients 
evaluate themselves. Patterson (1971) speaks to this issue: 

What then is the purpose of tests in client-centred counsel 

ling? The answer should be clear. Tests are used to assist 

the client in evaluating himself. It is the client who 

evaluates and not the counsellor. The ultimate purpose of 


tests~~indeed the purpose of counselling--is not to help the 
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counsellor understand the client (though they may do this, 

and understanding of the client by the counsellor is nec- 

essary) but to help the client understand himself. This 

confusion about the ultimate goal of counselling, the fail- 

ure to recognize that this goal is not simply knowledge 

about or understanding of the client by the counsellor, has 

led to a misunderstanding about the place of data and in- 

formation about the client in counselling. The result has 

been an over~emphasis on the collection of data, including 

test data, by the counsellor. It is not what the counsel- 

lor knows about the client, but what the client knows 

about himself, which is important. The client must make 

his own decision; therefore, he must make the evaluation. 

(p. 143) 

Briefly, client-centered counselling theory, founded by Rogers 
and elaborated by his students and colleagues, is based on the assump- 
tion that within all men there is a drive towards self-fulfillment. 
Within a warm, permissive interpersonal atmosphere these tendencies 
towards fulfillment will be realized. However, in a negative inter- 
personal climate the process can be short-circuited and growth inter- 
rupted. 

In counselling, the relationship between the counsellor and the 
client is a method of regenerating personal growth. In this regard, 
client movement is to a large degree accounted for by the level of 
counsellor functioning (Carkhuff & Berenson, 1967). A central charac~ 


teristic of a healthy, growth inducing climate is the absence of threat 


and evaluation (Rogers, 1951). Within a nonevaluative and nonthreat- 
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ening atmosphere, respect for the client, acceptance of him as a per- 
son, seeing his point of view (empathy) and being genuinely interested 
in him are conditions which, if adequately perceived by the client, 
should allow the client to examine and explore himself and his situa- 


tion and ultimately lead to growth (Rogers, 1957). 


An Empirical Analysis of Counselling Process and Outcome 

The client-centered position and subsequent extensions of it 
(Carkhuff, 1973) have generated considerable research. The focus of 
these investigations has been on the counselling relationship and its 
relationship to outcome. 

The impetus for much of the empirical work on counselling and psy~ 
chotherapy came from criticisms concerning the effectiveness of treat—- 
ments (Carkhuff, 1973). Eysenck (1965) and others (Levitt, 1963) re- 
ported that on the average psychotherapy was ineffective. In review- 
ing the studies cited by Eysenck (1965) it was noted that the treated 
groups in relation to the control groups showed significantly larger 
variances (Bergin, 1963). After examining the sources of variance in 
the treatment groups the conclusion was reached that psychotherapy 
could be for better or worse (Bergin, 19633 Truax & Carkhuff, 1964), 
and this finding led to an examination of counsellor and client vari- 
ables that were associated with positive and negative outcomes. 

Early research within the client~-centered position (Rogers, 
Gendlin, Kiesler, & Truax, 1967) focused on three counsellor variables: 
empathy, positive regard (warmth) and genuineness, and one client vari- 
able: depth of self~exploration. These counsellor-offered conditions 


were the ones seen by Rogers (1957) as being necessary and sufficient 
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for therapeutic outcome. Scales were developed by Charles B. Truax 
and his associates to measure these constructs (Iruax & Carkhutet, 
1967). These instruments were refined by Carkhuff (1969), and new 
measures were added. With the exception of the scale to measure un= 
conditional positive regard, the Carkhuff instruments seem to be very 
similar to the Truax scales. Raters were trained on these instruments, 
and after training they rated recorded portions of interviews. In 
order to clarify the facilitative conditions the following brief des- 
criptions of the instruments which were used in the early studies are 
presented. With the exception of warmth, all of the descriptions are 
based on the revised scales (Carkhuff, 1969). 

Empathy. On the Carkhuff (1969) empathy scale (see Appendix A) 
scores below Level 3 should coincide with counsellor statements that 
are inaccurate with respect to client feelings and/or detract in some 
way from the client's ongoing experience. Scores for Level 3 or above 
are assiened to statements that accurately describe the client's feel- 
ings Vand aid “clients in exploring their situation. 

Warmth. On the scale for measuring unconditional positive regard 
or nonpossessive warmth at low levels the counsellor expresses dislike 
or disapproval or expresses warmth in a selective way (Truax & Cark- 
huff, 1967). At high levels the counsellor warmly communicates his 
acceptance of the person without imposing conditions. 

Genuineness. On the Carkhuff (1969) genuineness scale (The Fa- 
etisttasrive Genuthenéss in Interpersonal Process: A Scale for Measur= 
ment) the counsellor functioning below Level 3 generally responds to 
the client in a manner that is unrelated to what the counsellor is 


feeling, and the counsellor functioning at this level does not use his 
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negative reactions constructively. Counsellor expressions for Level 
3 or above seem to be reasonably congruent with the counsellor's feel-= 
ings. 

Depth of self-exploration. On this scale (see Appendix B) client 
statements which are remote, impersonal and/or mechanical are assiened 
a low score. On the other hand, statements exhibiting emotional prox- 
imity and featuring the voluntary introduction of personality relevant 
material receive higher scores. 

The effects of levels of empathy, warmth and genuineness on cli~ 
ent depth of self-exploration has been experimentally manipulated. 
Truax and Carkhuff (1965) had therapists lower their levels of func- 
tioning during the middle third of an interview. They found that this 
manipulation had a direct effect upon client depth of self~exploration. 
That is, when therapists lowered their levels of functioning there was 
a consequent drop in client depth of self-exploration, and at a pre~ 
arranged time when therapist-offered=conditions rose, there was a con- 
sequent rise in the client's level of self~exploration. 

In another investigation employing a similar design Alexik and 
Carkhuff (1967) examined the effects of manipulating client depth of 
self-exploration upon counsellor level of functioning. They selected 
a high and low functioning counsellor from ratings of their performance 
in a previous study on the empathy, unconditional positive regard, gen- 
uineness, and concreteness scales. When a client (confederate) lowered 
her level of self-exploration, the highly rated counsellor increased 
his overall level of functioning, while the overall performance of the 
counsellor with the low ratings declined. After the client raised her 


level of self-exploration there was a slight rise in the level of func- 
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tioning for both counsellors. 

In another study usine the same format Piaget, Berenson and 
Carkhuff (1967) employed one high and one moderately rated counsellor 
interviewing high~ and low-rated counsellees. Both client and coun- 
sellor level of functioning was assessed using the Carkhuff scales. 
During the middle portion of the interview, when the counsellors low- 
ered their level of functioning, the depth of self~exploration of low- 
rated clients declined, while the depth of self-exploration of high- 
rated clients showed a nonsignificant fluctuation in the same direc- 
tion. However, with respect to the overall level of functioning at 
the end of the interview all clients of the high functioning counsel- 
lor improved their level of self-exploration, while for the low func- 
tioning counsellor the depth of self-exploration for both high and 
low—rated clients declined. Moreover, it was found that the counsel- 
lor level of functioning was not affected by the client level of func- 

* ° i 
tioning. 

Anderson (1968) investigated the effects of confrontation using 
high and low functioning counsellors. She found that confrontation by 
a high functioning counsellor was more frequently associated with in- 
creased client depth of self-exploration than was confrontation by a 
low functioning counsellor. 

These findings and those of other studies have led to several im- 
portant conclusions about the counselling relationship (Carkhuff, 1973) 
and provide support for the Rogerian position (Rogers, 1957). Essen- 
tially, these early studies suggested that the counsellor” level ot 
functioning was directly related to client level of functioning, and 


that it was the former which seemed to cause or at least be a primary 
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factor in determining the client's involvement in the counselling pro- 
cess. Moreover, with respect to the client's level of functioning 
over time the implications were clear. That is, if a client differen- 
tially explores his feelings with high and low functioning counsellors, 
then it seems likely that he will tend to move in the relative direc- 
tion of the rated conditions offered by the respective helper. In 
general, the clients of high functioning counsellors will improve and 
those of low functioning counsellors will decline (Carkhuff, 1973). 
While the experimental manipulations of counsellor and client 
functioning have provided interesting insights into the nature of the 
counselling relationship, the data with respect to the counselling 
outcome has been less than clear. After a comprehensive review of the 
literature Truax and Carkhuff (1967) conclude that empathy, warmth and 
genuineness are associated with positive therapeutic change. That is, 
high levels of these conditions are associated with changing "people 
for the better" (p. 141). An examination of the findings from the 
Wisconsin study on schizophrenia revealed both positive and negative 
relationships between the facilitative conditions and various outcome 
criterion (Rogers, Gendlin, Kiesler, & Truax, 1967). Similar incon- 
sistencies appear to be the rule rather than the exception. For example, 
Truax and Carkhuff (1967) report a correlation of .70 between self~explora- 
tion (tape-judged) and eventual case outcome. Kurtz and Grummon (1972) 
reported that tape-judged self-exploration was related to tape-judged 
empathy, but it was not related to either client perceived empathy, 


as measured by the Barret-Lennard (1962) scale, or to outcome. 
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The inconsistencies in the counselling outcome literature may , 
in part, be attributable to the Truax and Carkhuff scales. However, 
problems in this domain are often related to a lack of correlation be- 


tween various process and outcome measures (Bergin, 1967). 


Scaling Problems with Tape-judged Instruments 


Independence of rating instruments. The independence of the 
Carkhuff scales has been the focus of several investigations. Carkhuff 
(1969) has developed seven scales that purport to measure separate as- 
pects of the therapist's behavior. Muehlberg, Pierce, and Drasgow 
(1969) reported that a "good guy" factor accounted for 89% of the vari- 
ance among empathy, unconditional positive regard, genuineness, con- 
ereteness and counsellor self-disclosure scales. In another study 
using graduate student responses Hefele, Collingwood, and Drasgow 
(1970) found that one factor accounted for 79% of the variance. Chinsky 
and Rapport (1970) and Bozarth and Krauft (1972) discovered that "good 
therapist" and "likability" ratings correlated .45 and .27, respectively, 
with scores on the Carkhuff (1969) empathy scale. When the "“likability" 
component was partialled out of the "good therapist" ratings, good 
therapist still correlated significantly with empathy, but the converse 
was not true. 

As Gormally and Hill (1974) have noted these findings raise seri- 
ous questions as to the specificity of the measuring instruments; i.e., 
either the instruments are not separate or counsellors high on one 
dimension are high on all dimensions. Moreover, there are doubts about 
whether or not the raters are responding to counsellor characteristics 


beyond the conditions of the Carkhuff scales. In sum, while a global 
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quality has not been proved, there is reason to question the indepen- 
dence of these scales. 

Selection of raters. The rating problem has received consider- 
ablé attention. The question has been raised as to who is the best 
judge of counselling: independent raters, counsellees, or counsellors. 
Kiesler (1966) found that naive judges and clients tended to agree on 
their perception of counselling for both the Barrett-Lennard Relation- 
ship Inventory and client depth of self-exploration. On the other 
hand, counsellor ratings tended to be in opposition to their views. 
Burstein and Karkhuff (1968) have noted that clients tended to distort 
their perception of the facilitative conditions. The distortion issue 
was examined by Kaul, Kaul, and Bednar (1973). They reported that 
client's ratings of their performance on the depth of self-exploration 
scale were significantly higher than those of trained raters or coun- 
sellors. The authors seemed to feel that the source of this differ- 
ence was in the perceptual sets ("phenomenological base rate") of the 
three groups. They suggest that the clients gave a true picture of 
their self-exploration, but that the perceptual sets of the raters and 
counsellors more closely approximated the ideal. In focusing on the 
same issue, Caracena and Vicory (1969) found no relationship between 
the ratings of trained judges and nonclient interviewees from the same 
population. They conclude that clients do not distort--they simply 
lack discrimination training. 

Rating and experience. It has been suggested that different rater 
characteristics may affect the scaling process. Kagen (1972) is of 
the opinion that the extent to which raters assign lower marks to 


counsellors for not detecting subtle messages may be a function of ex- 
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perience, because experience may be the crucial variable in developing 
sensitivity to the subtle aspects of interpersonal communication. 
Therefore, the experienced counsellor, in relation to the counselling 
graduate student or naive rater, may assign a lower mark to a counsel- 
lor response that does not fully grasp the significance of a client's 
statement and/or position but still leads the client to greater self- 
exploration. 

In order to circumvent this problem, Carkhuff (1969) has suggested 
that only high functioning communicators should serve as raters. 
Gormally and Hill (1974) observe that choosing such a rater requires a 
high functioning rater and that circularity results. 

There are obviously problems with respect to the validity, spe~ 
cificity of the Truax and Carkhuff scales. However, the problems are 
not confined to these particular instruments but seem to be endemic to 
the areas of personality measurement and psychotherapy.research. In 
regards to the latter, it was noted earlier, that different outcome 
measures are often used in different studies; however, these instru- 
ments rarely correlate with each other (Cartwright, Kirtner & Fiske, 
1963). In addition, the various process instruments for measuring con- 
structs like empathy have been found to be unrelated or only slightly 
correlated. Kurtz and Grummon (1972) found that only two of six mea- 
sures of empathy were correlated (client~perceived and the Carkhuff 
tape-judged empathy scale). 

In summing up the extremely complex and confusing literature with 
respect to counselling-therapy process and outcome the comments of 
Donald W. Fishe (1975) would appear to be appropriate. 


Thus the researcher studying personality, and particularly 
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psychotherapy, has a choice, First, he can obtain highly 

objective data on concrete variables, with very high agree- 

ment among observers, at the cost of ignoring distinctive 

sources of data. It is not clear, furthermore, whether 

research on concrete variables will contribute to our un 

derstanding of process and outcome in psychotherapy. sec 

ond, he can accept the apparently inevitable finding that 

different sources of personality data will show only lin- 

ited agreement on the complex, judgemental variables which 

refer to the concepts involved in most thinking about psy- 

chotherapy. Given the contents of current concepts of 

personality and psychotherapy, most researchers will choose 

this alternative, at the cost of little agreement among 

sources and only fair agreement among separate measures ob- 

tained from the same general source. (p. 22) 

In this experiment the latter route was followed, and both client 
and counsellor behavior were measured using the Carkhuff (1969) scales 
of empathy (see Appendix A), self~exploration (see Appendix B) and con- 
frontation (see Appendix C). In addition, client ratings on the Coun- 


selling Evaluation Inventory were elicited (see Appendix Ds 


Institutional Role of Pretoemsciior 

In practice, psychologist~counsellors often function as mediators 
between the individual and the institution. Sometimes, they evaluate 
or determine the criterion for evaluation. In an administrative ca-~ 
pacity psychologists are involved with: admission and/or admission 


standards, promotion and/or the criteria for promotions, what informa~ 
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tion will be kept in the student's or employee's file and who will 
have access to that information, and the testing policy of the school 
Or organization (Shertzer & Stone, 1968). 

Within the counselling profession there has been a growing aware- 
ness that the effectiveness of the counsellor may be limited by his 
institutional role. A counsellor who agrees with the Patterson (1971) 
position with respect to evaluation would feel uncomfortable in an ad- 
ministrative-counselling role that would not allow him to devote his 
full attention to the needs of the client. Other writers have ex- 
pressed concerns about what they feel are necessarily incompatible 
functions; i.e., counselling and administration. The reservation has 
been expressed that once the counselling service identifies itself 
with authority it will become a "tool of the administration and a nem- 
esis to the student" (Erickson & Smith, 1957, p. 5). Other writers 
have been more tempered in their approach to the problem. Rempel and 
Sartoris (1970) concluded that adding the administrative role will 
"ultimately make the task of the counsellor a more difficult one" (p. 
20). Separation of the counselling and administrative functions in 
order to eliminate role conflict has been proposed as one solution to 
the problem (Rempel, Sartoris, & VanderWell, 1968). 

In brief, the position taken by most writers who feel that the 
counsellor's role and the administrative function should be separated 
appears to focus around three central concerns. The primary one seems 
to be that even with the most flexible, client-centered administration 
there will inevitably be a conflict between the counsellee and the ad- 
If the counsellor is required to act in an administra=- 


ministration. 


tive capacity, then his loyalty may be divided. Consequently, ser- 


pad 


a " 
f ‘ a : 
is Aolunitese ati thed le en eee aes 8 
rye i m rm, 
¢ - 
7 r rd A Ve epochs) 


j } : ry ” i= | By. iy ¥ ; us 
« j 
| £4 wy vaprtvg ties: I< 
a 
; ; : v).%og.4 
— 
a tu pi 3 ie se | , 4 } 
i rt he is ey 
7 i 
j } Voce ae nt 4G r 
j ihe) ay ha dase P 
Lome) 12) i eines voir seed 
i 
i, iua ayien) fe | 3) ‘ 


7 


et Lover —_ : o. ot 

NY? r aid jt: 
[ ‘ . Ve > nd f, i PMO ES “See ) Oy 
i nies r, 8 " 
} Vevea | 7 ang ' ’ at 7 Ti ’ te 4: ai -_ wee 

Pa r : ingest } a Ore ee 6 cies cr 
bp had a 
Uh es rl TL Swaw tel Land)! <al Fi Ks | se) — logis 


votiowed Givi debra benlithan her eb fe ib sol tf 6) a gl eRe . 
ie ) j - Y ar i 


ae | 
- © * 
ae » Ae OY tls 
- ae 


pi 
Biligtes: 'e 


mt 
~, 
“<. 
“ 
z< 
= 
¥ 
> , 
: 


tS + a 
g : MoAIE3I Te bat }) eee 


: od ies ag boride. 08) i La aun uf: 
7 P : 4 ory aT) 
-_ rr ‘ae a) jel : ermitt ‘tie op sate a 7 ce 


Ae | 
a a of 


hop mn . Dbain au] 3 cals 


a 


Service to the student may be less than optimal. The second area 
seems to be tantamount to guilt by association. For example, Arbuckle 
(1966) has expressed the concern: "The counsellor who is surrounded 
by tests is indicating his approval of such instruments of appraisal 
and the fact that he approves of them makes him part of the total ap- 
praisal" (p. 300). The image of the student-oriented counsellor may 
thus be damaged. Thirdly, when the counsellor acts in an administra- 
tive or disciplinary role, he begins to resemble other authority fig- 
ures from the student's past, and these old associations could intrude 
upon the counselling encounter and impede or block any therapeutic in- 
volvement with the client (Rempel, Sartoris, & VanderWell, 1968). Di- 
rect and even indirect involvement with the maintenance of institu- 
tional roles could negatively effect both the client and counsellor 
and impede the establishment of rapport. 

| There have been two studies which have focused on the counsellor's 
role vis-a-vis the institution. Brown and Calia (1968) looked at the 
effects of required versus self~initiated interviews at a university 
counselling centre. They found no difference in the client's rating 
of the self-initiated and required treatments. However, two of the 
four counsellors saw themselves as offering higher levels of Uncondi- 
tional Regard under the self-initiated condition as opposed to the re- 
quired treatment, while the reverse was true for another counsellor. 
Brown and Calia (1968) also found that counsellees, when required to 
see a counsellor, spent less time in the counselling interview than 
those who came voluntarily. The authors conclude that: | “counsellor®s 
bias rather than the client's behavior is most likely to impede the 


effectiveness of the initial interview” (p- 405). 
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Mann (1971) studied two variables, referral source and test seek- 
ing. He found that faculty~referred cases as opposed to self~-referred 
clients tended to have more difficulty in reaching a contract with the 
counsellor (p = .08). He also found that the client's request for 
testing did not affect the establishment of the counsellor-client con- 
tract. However, he discovered that 86% of the self-referred test seek- 
ers but only 57% of the faculty~referred were able to negotiate a suc- 
cessful contract. He interpreted this finding "as suggesting that the 
counsellor is more likely to accept the client's request for testing 
at face value when it is seen as coming from the client himself rather 
than a faculty member" (p. 224). 

The above research suggests that institutional intrusions _— af- 
fect the interview behavior of the counseilor more than the client. 
This conclusion is tentative and based upon the speculations of Mann 
(1971), and Brown and Calia (1968). Unfortunately these works appear 


to be the only two studies in the literature which are even remotely 


related to this project. 


Confrontation and the Institutional Role of the Counsellor 

The confrontation scale (see Appendix C) has not been the subject 
of as many investigations as the empathy and depth of self-exploration 
scales: however, the variable has appeared in a number of studies (e.g., 
Kaul, Kaul, & Bednar, 1973; Anderson, 1968). In brief, a low score on 
the scale, below Level 3, indicates that the counsellor is ignoring, 
avoiding, or does not perceive discrepancies in the client's behavior. 
Scores of Level 3 or above are assigned to counsellor statements that 


A . . ' * 
focus on discrepancies in the client's behavior. 
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A confrontative style would seem to be particularly relevant to 
the evaluative encounter. As noted above, the bOtent ral” for cone lice 
between counsellor and client is incorporated within the evaluative 
setting. It is assumed that the client by virtue of his intent to re- 
enroll or at least consider the possibility of reenrollment is being 
pushed by some motivational force towards a goal. This goal or the 
client's motivation may not be congruent with the counsellor's percep- 
tion of the client, the test results, the client's previous academic 
record, his choice of programs, etc... In an evaluative interview 
where the counsellor must report on the client's readiness for readmis- 
sion, there would seem to be external pressure on the counsellor to 
resolve these discrepancies. One obvious method of bridging the gap 
between the two positions is to confront the client. 

On the other hand, in a nonevaluative interview, where no deci- 
sion or report is required, a counsellor might overlook inconsisten- 
cies in a client's behavior that he would not generally pass over in 
a written communique to a colleague or school administrator. It also 
seems intuitively obvious that in a nonevaluative setting the counsel- 
lor would have more flexibility in choosing his approach. 

However, other factors, such as divided attention and/or loyalty 
suggest that the counsellor's capacity to detect or respond to discrep- 
ancies in the client's behavior may be reduced in the evaluative rather 
than the nonevaluative interview. 

In sum, while confrontation as measured by the Carkhuff scale 
seems to be relevant to both the evaluative and nonevaluative encoun~ 


ters, the effects of these treatments on the levels of counsellor func- 


tioning does not appear to be straightforward. 
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Counsellor~related conclusions. Carkhuff and Berenson (1967) ‘ar- 
gue that it is the responsibility of the counsellor to offer his “cli- 
ents 100%" of his own experience. It is the counsellor's attitude 
and sensitivity which enable the client to reach more personality re- 
warding levels of intra-personal and inter-personal functionines. | Ef 
required to fulfill an evaluative role, the counsellor's capacity “to 
effectively serve the client may be limited. This expectation is very 
much in line with Kell & Mueller's (1968) hypothesis that when diag- 
nosis is maximized the quality of the relationship (counsellor=cliént) 
is minimal. Rogers (1975) has stated that true empathy is always ‘free 
of an evaluative or diagnostic quality. Moreover, it is a primary ‘con- 
cern that, in spite of the orientations and good intentions of the 
counsellor that when institutional-evaluative goals must be met, the 
counsellor's attention will be divided, and focus on the client will be 
restricted. If counsellor functioning is restricted or in some way “in= 
hibited by evaluation, then the levels of empathy and possibly confron= 
tation offered to the client will be lowered, especially in relation 
to the levels of these conditions offered in a nonevaluative atmosphere. 

Client-related conclusions. From the client's point of view it 
is felt that the absence of evaluation will facilitate self-examina- 
tion and exploration (Patterson, 1971). If, on the other hand, clients 
perceive the counselling situation as threatening, then they may be 
come defensive and/or aggressive. For example, if clients are required 
to get past an institutional gatekeeper, then chances are that they 
will not examine their needs for fear of jeopardizing their position. 


Other writers have reached similar conclusions. For example, Chronbach 


(1960) states: 


pais eet 1 ee 4 a 


A 
| i AS), a | : ee 
eT iboats rw c Larosa 8,4 ; tae aia sara 18 Brn 
i ih 7 eu Sal 


wo er) i : t } > ri j a3, if ia av ‘sian: 9 bey My ‘ if t ded bes Tt “Fr 


‘j i sna ods my ene. Yo 
Ny, pu | 


A Lf ins , 
ie ae Pin Le 
i a 
‘ R | f "ste aa tenes } Mi h pola 
Hi be 


di 7 re Reet ee nyt Lia % 
iy ate oa bbe ive i 


try dG Vis \ G8 shes Jin is ‘a. qohee 1 Lem 
dey DL igehe ees eae abe ha iahlae fe tin ‘tat sea 
: i Me Wh ee 
: 7 we, 
(el f/aa 2 bank ally at se % iy ti ai er asad 
; Aj i ; , 4 
; f fa ; we, hh ahaa . aN 
4 2 
he Ve) Oa yh eaeg SPISieaA SD As MY Ue Ne sant f ig ody dust ia 
oe | \ y 7 ie 


agoyindis ViGts brine Vet {6 sania ony ah ao ue 


yom sega,» Dy 


' noi. ot f Vibes eet brett AT ALL iy a wickets we 


Sa wae SOAs SU LIA Lay Mi) .& at L v3 4am 130 ist 


7 Oe aee e Ca) oe 
TEC LHe be 2 To thy = aes Lt ae Lay Be Agia 
a) ye Ad 4) - 


‘ , . ih rhe i ap 7 ne ae: ¥0 
& me warts atti i 1 if 7 The nd 5 Lea i ae igi a i cy 
: | We ‘" Ns a ad " ; y ie ens i 
yee) ee My ii Se ity TTS0L3, carne Gi ied ne 
; ) ih fic) : a 
6 a ny ake re! - i 
wife ana hl 5, oa vi onal erg 
© 15 F) fer 7 
seme: i strhastett 19 ja pe et 23 
. iy f ; 


ate tana $8 3 ra 


| ipl ogee ii 


1 
a 
y 


- 


- 


7 s¥ 
Pisin 
nl 7 


ne 


We 


26 


Complete frankness cannot be anticipated in any situation 

where the subject will be wewended or punished for his re- 

sponse. Some degree of reward or punishment is implicit 

in any institutional use of tests such as clinical diag- 

nosis or employee selection. Honest self-examination can 

be hoped for only when the testor is helping the subject 

solve his own problems. (p. 454) 

If clients hold back their feelings in an evaluative encounter, 
then there are reasons to suspect that their perceptions of the encoun- 
ter will be negative or in some way diminished. However, the removal 
of the feared result (denial of readmission) should allow clients to 
express a fuller range of feelings. Thus, clients should experience 


greater satisfaction with the nonevaluative encounter. 
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CHAPTER III 


METHOD 


Subjects 


Subjects were 99 former University of Alberta students who had 
failed one year (to the extent of being required to withdraw) and were 
seeking readmission for the 1973-74 and 1974~75 school years to the 
Faculties of Arts, Science, and Education after an absence of at least 
one year. The population is described in Table 1. All applicants 
from other faculties, those with two or more academic failures, trans- 
fers from other universities (who by University of Alberta standards 
had failed their last academic year) and former students seeking imme- 
diate readmission after being required to withdraw ere excluded from 
the project. These limits were set by the Director, Student Counsel- 
ling Services, University of Alberta. 

A standard test battery was administered to all Ss. This test 
battery consisted of the following instruments: Ohio State Psycholog- 
ical Examination, California Personality Inventory, and the Strong 
Vocational Interest Inventory. The numerical subtest (Q) of the Amer- 
ican Council on Education Psychological Examination was administered 
to Ss applying for admission to the Faculty of Science. These tests 
were representative of the ones routinely assigned to applicants seek- 
ing readmission after failure; however, in order to insure uniformity 


the E rather than the counsellor assigned the tests. 


Treatment Groups 


Subjects were assigned to one of two treatment groups. In the 


evaluative treatment, which has been the standard procedure for as 
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TABLE 1 


DEMOGRAPHIC CHARACTERISTICS 
OF THE SAMPLE BY TREATMENTS 


ae en mete rt 
a a Eh ee 


Treatment 
Source Evaluation Nonevaluation 

Sample Size (N) 54 45 
Sex 

Male 39 33 

Female LS 2 
Mean Age 7 NPs 229 
Grade 12 Average 66% 66% 
Year of Failure 

First 29 Ze 

Second 15 16 

Third 10 i 


Percentage of group 
membership with only 72% 65% 
a one~year absence 
after failure 


Mean number of years 
away from university a esis, 
after failure 


Total 
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long as anyone on staff can remember, Ss were required to complete a 
battery of tests and to appear for a counselling interview. The pri~ 
mary purpose of this procedure was to enable the counsellor to make a 
recommendation concerning the probability of the client's future suc~ 
cess with his academic program. In effect, this amounted to an at= 
tempt on the part of the counsellor to assess the reasons for failure, 
to evaluate the current test results, and to make a prognostic state- 
ment to the administration concerning the client's chances for academic 
success. 

A second group of Ss were tested and interviewed; however, the 
conditions of the interview were altered. In this group the responsi- 
bility for choosing whether or not the student would return to univer- 
sity was left to the discretion of each & This is essentially  non- 
evaluative or self-selection treatment, and the onus for choosing 
whether or not to return to university was shifted from the counsellor 
to the client. 

Special permission was obtained from the faculties to admit all 


Ss, even those who received a negative recommendation from a counsellor. 


Counsellors 


A junior staff member and three counselling internes served as the 
counsellors for this project. All were registered as students in the 
Department of Educational Psychology, University of Albevta.1 Three, of 
the four counsellors had obtained undergraduate degress in psychology. 
The other counsellor had an R.N. and an M.A. (romance languages). ALL 


had completed at least two years of full-time course work towards an 


M.Ed. or Ph.D. degree in counselling. 
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There were two teams of counsellors, each with male and female 
member. One team, Counsellors 1 and 2, took part in the study during 
the spring and summer of 1973, while the other team, Counsellors 3 and 


4, was involved in the project from January, 1974 until August, 1974. 


Procedure 


The various steps involved in processing Ss are outlined in Fig- 


ure 1. 
i. Contact with 2. Assignment to treat= 3. Testing 
Counselling Service ments. Letter sent 

to Ss in nonevalua- 
tive treatment. 

4. Interview 5. Counselling Evalua- 6. Counsellor’s 
tion Inventory com- recommendation. 
pleted Readmission 


notice sent to 
Faculty stor Ss 
in nonevalua~ 

tive treatment. 


Figure 1: Flow chart of experimental procedures 


The assignment of Ss to treatment groups (see Steps 1 and 23 Fig- 
ure 1) was more or less on an alternate basis and occurred at the time 
the E became aware of the S's intent to return to university. There 
were, however, exceptions. These exceptions involved a control group 
whose members were not required to report for counselling. This group 
was not part of this study; however, the alternate assignment to treat- 
ments wags modified and the modifications involved the control group. 
The modifications were twofold. Firstly, applicants from *‘out of town" 
were more frequently assigned to the control group in order to save 
them the trip to Edmonton. Secondly, because of counsellor vacation 


schedules most of the $s were assigned to the control group in mid- 
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late July and August. This bias was most pronounced in August, 1974 
when 25 of 43 Ss were assigned to the control group. 

A letter (see Appendix E) was sent to all Ss placed in the non- 
evaluative condition (Step 2; Figure 1). This letter explained the 
special conditions for readmission. 

A standard test battery was administered to all Ss. (Step 3; Fig- 
ure 1). 

All Ss received an appointment at the Student Counselling Services, 
University of Alberta (Step 43; Figure 1). While one hour was set a- 
side, the interviews only averaged 36 minutes. The mean times for the 
interviews are presented in Table 2, and the summary of the analysis 
of variance for interview times is presented in Table 3. The total 
mean difference between the counsellors was significant (p = .04). A 
Scheffe Analysis of the differences between various combinations of 
means showed a significant difference between counsellors 2 and 3 (p 


= .05), but none of the other differences were significant. 


TABLE 2 


MEAN INTERVIEW LENGTH FOR 
COUNSELLORS BY TREATMENTS 
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TABLE 3 


SUMMARY OF ANALYSIS 
OF VARIANCE FOR 
INTERVIEW LENGTH 


Source DF MS F P 


A (Treatments) L di ye Sou 
B (Counsellors) 3 507 Pyle 04 
A XB 3 367 2203 malas 
Error 81 180 
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Each of the interviews was rated for content (see Appendix F) and 
description of the process is presented in conjunction with a descrip- 
tion of the other rating scales. It can be seen in Table 4 that per- 
sonal and vocational themes accounted for approximately 63% of the in- 


terview content. 


TABLE 4 


SUMMARY OF THE COUNSELLING SEQUENCES 
RATED FOR CONTENT 


a RN NE 


Scale hen coneNeeece ge Sequences Rated 
es pee ae ee ee ee ee 
Vocational | 31.8 
Personal Shek 
Educational 16.1 
Testing Teeth 
Administrative 7.6 
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At the beginning of each interview permission to record the ses-= 
Sion was requested. Moreover, counsellors were asked to check with 
each § in the nonevaluation group to make sure that they understood 
the conditions for readmission. There were no further experimental in- 
terruptions until the end of the session. At this time all Ss seen 
were asked to complete the Counselling Evaluation Inventory (Step 53 
Figure 1). 

After the interview the counsellor was required to write a letter 
to the administration for Ss in the evaluative condition (Step 6; Fig- 
ure 1). While the style and content of these letters varied from 
counsellor to counsellor all of the letters included a summary of the 
test results and a prognostic statement with respect to academic per- 


formance. 


Analysis 


All interviews were tape recorded and two-minute sequences were 
extracted from the beginning, middle and end of each interview. Each 
segment was judged by trained raters on scales of empathy, self-explor- 
ation, and confrontation. The order in which the beginning, middle, 
and end sequences were placed on the master tapes was scrambled. To 
further reduce any possible carry~over effect four tape recorders were 
employed. On each recorder was a master tape with the sequences from 
several interviews. The rater was required to judge a sequence, then 
change tape recorders for the next rating. This method insured that 
only one out of every four segments was from the same interview. 


The six judges were all counselling graduate students with at 


least one year of graduate training. There were five females and one 
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male, and they were divided into three teams with two members per team. 
Each team rated one scale. 

The empathy and confrontation scales were selected because they 
emphasize accuracy in communicating information to the client. In this 
counselling situation accurate communication was considered important. 
While other scales such as genuineness, respect, counsellor self—dis-— 
closure and immediacy might have proved useful, these instruments would 
seem to be more relevant to other situations, such as psychotherapy. 

The self~exploration scale was used, because it appears to be the 
most generally accepted process and/or outcome measure of all the 
tape~judged scales (Kaul, Kaul & Bednar, 1973). Moreover, in the lit- 
erature on evaluation a great deal of emphasis is placed on the feel- 
ings of the client (e.g., Dailey, 1971). The Counselling Evaluation 
eeeneoR? was selected, because it was a brief measure that included 
questions about tests. 

Empathy. The Empathic Understanding in Interpersonal Process: A 
Scale for Measurement (Carkhuff, 1969; see Appendix A) was used in the 
experiment. 

The instrument was modified from a basic five-point into a 17- 
point scale. Raters were asked to make judgments at quartile intervals 
rather than the usual procedure of having them rate on the integers one 
through five or half marks on a 9~point scale. Agreement between judg- 
es was set so that any two ratings on the same sequence had to be with- 
in .50 of each other. For example, ratings of 2.75 and 3.25 were 
judged as being in agreement. Disagreement between judges occurred 
when two ratings differed by more than .90, such ds Z2.i3 and 3290,” In 


all cases where there was a disparity between estimates, the judgments 
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were averaged, and this average was used in the final tabulations. 

The training on the empathy scale focused on the ratings and dis- 
cussions of client~counsellor statements. There were two training 
sessions which totalled approximately four hours. The method emp Loyed 
was similar to the procedure described by Carkhuff (1969), and dis- 
a eee between rater estimates and those of expert judges were dis- 
cussed. Training materials were extracted from Bozarth and Krauft 
(Note 1) and from tape recordings of Robert Carkhuff (Parker, Note 2). 

At the end of training there was a validity-reliability check us- 
ing pre~rated, three-minute segments from counselling interviews. The 
Segments were, in part, the same ones used by the scale developer to 
train his raters and all of the sequences were rated by Robert Carkhuff 
and his associates (Calder, Note 3). The interrater agreement on 10 
trials were perfect. Moreover, all the ratings of both judges were 
within .5 of the expert ratings. 

After training, the overall reliability of the raters declined. 

On two, 40—item segments the interrater percentage of agreement was 55 
and 58. The interrater reliability in the most recent literature ap- 
pears to fluctuate between .60 and .80 but the range of reliability 
coefficients reported was quite large, 259 toa. O5Satiruasc Se Garkhi his 
1967) . 

Self-Exploration. The Helpee Self~Exploration Scale in Interper- 
sonal Process: A Scale for Measurement was used in the experiment 
(Carkhuff, 1969; see Appendix B). 

This instrument was modified like the empathy scale. That is, the 
basic five-point scale was transformed into a 17-point scale, and a- 


greement and disagreement were judged according to the same criterion. 
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Moreover, the same written and recorded material was used in training 
and checking reliability and validity of the raters. 

Training took only three and a half hours. At the end of the 
training, interrater agreement was reached on 11 of 12 three-minute 
segments extracted from counselling interviews (Calder, Note 3). On 
23 of 24 of these ratings there was agreement between trainees' judg- 
ments and those of the E. The E's judgments were used as the crite- 
rion for validity, because no other external sources were available. 

The agreement between raters on the recorded data was consider- 
ably higher for this instrument than for the empathy scale. On two, 
40-item segments the interrater agreement was 75 percent and 80 per- 
cent. These ratings compare quite favorably with those reported in 
the literature. Truax and Carkhuff (1967) reported reliabilities from 
12 studies ranging between .59 and .88. 

Confrontation. The Confrontation in Interpersonal Process: A 
Scale for Measurement (Carkhuff, 1969; see Appendix C) was employed in 
this experiment. 

There was no modification of this scale. However, the aforemen- 
tioned material was used for training and checking reliability and va- 
lidity. Raters were trained for four and a half hours (two sessions). 
There was interrater agreement on 14 of 16 three-minute segmants of 
counselling interviews. Additional tape recordings of counselling seg- 
ments were used to compare the E and the trainees ratings. This check 
was the only source of validation available. There was agreement be= 
tween them on 26 of 32 items or 80 percent of the segments rated. On 


the data for this study the interrater agreement on two, 40-item se- 


quences was 83 percent and 95 percent. In the literature the inter= 


i) ° i . : ‘ 
sho mat 3] nha % - 
‘ \)\s “ee iy oH 


’ rs vr ts heer 2 y iv . 
Rie ee ts! im 3 es ie re ins Orly es7 bats Mi me 


nh 


> t 78 7 I 4 eae Ne igs ta S8 ™ gsvkolow A sits 
; ih. Se Papa 
' “aaa. 2% tity oy Bn oh iy Ss Sy, 7 fe! is oythe, vial ; rnin k3 7 at 
gidberea ls |S yl 4 badge ; | aol igh 91 
pubes facet Binks Yate ipba Win A a 
2 , Veh Cin ey * nag 
Py Ya r 4 
se its erin cuett te 
7 " ibe AT i 7 
’ i ispury ey ‘ > ‘ iat RD 
=a). et . : 
rn ‘ re t Vins ; #¢ } hid th , nly fxs | ' ] ¥ wT } inv 
J Lie “4 4d yn iy L eCisIor = 
| i ae Sp he certs 29 
i | 
Be. sacha oyt) at analy | 
i : » ax | i Lon 
Pet dono wie lyn aie steal 
a | 4 Al 
ei : 11osas te ae + th ee re y oi . - rie os 
5 vA Si a 
; ai 
nae bf x Neo) Nabe ar sp kel 
ha a AF et i we ¥ a 
Ph ; > iY ait 
; fsuopdedte inl rer iglerkte tan bolas : 
wee A wor a if hove 
J mYOLG (7) SOLD OST ieee CROEL. tehggtifeo) oe 
: Bs MA a 


‘ i i a de ve is 
) F re Sie 


avis | io ora 


oN ra se 


ne “li 
i p vs a a Ni 
ble 28 tivated ie aR een i 
" in ; ay ee - Py rae + 


“yu on 5: panit 


- 


mv et hte x 
; 10> = inbweoe pia Mi et ME tit) neds 4 
. pe 1) ‘a vs d ‘ i : ne i 
, ie NOPD Mi) 
ip g ra & act Li ! ns = ens he Aes be tf i i ‘ 


uy 
y Vee lie 


16 ‘ i BS a enithd fa ee 


ea ae 


. iy 
: he ‘Abas vrs asym, aM, . i : od 
Ps 1 eee x 

hs | aed demu 1aF rts at 


pera Mat 
“pay 


ad 


vf 
Ae 


af 


rater reliabilities seem to be fairly high, .80 to .90 (e.g., Anderson, 
1969; Kaul, Kaul & Bedner, 1973). 

Confrontation was not rated as a continuous variable. That is, 
if in the rater's judgment the scale was not appropriate to the inter- 
view-segment, then no score was assigned. There were several cells 
with missing data, and as a result, a repeated measures analysis was 
not considered apprepriate (Winer, 1962). 

In order to make the scores more amenable to analysis a process 
similar to one used by Kurtz and Grummon (1972) was completed. First 
the means from the beginning, middle and end segments (see Appendix E) 
were compared to insure that they ene not significantly different 
from each other. In order, the mean confrontation scores for the be- 
ginning, middle and end segments were: 2.4, 2.3 and 2.3. The differ- 
ences between these scores were not significant. Thus, the score for 
each S were combined by averaging them across the three segments. This 
combined score was used for analysis. 

Counselling Evaluation Inventory (CEI). This instrument (see 
Appendix D) was selected as a dependent variable because counsellors’ 
perceptions of counselling seem to be positively related to outcome 
(Bergin, 1967; Kurtz & Grummon, 1972). Moreover, for the evaluative 
and nonevaluative interviews this instrument has reasonably good face 
validity, because it includes questions about testing. Most of the 
other rating scales that focused on counselling climate were designed 
to measure psychotherapy and did not seem to be as relevant to the re-~ 
admission interview as the Counselling Evaluation Inventory. 

The Counselling Evaluation Inventory was developed to assess the 


reactions of students to counselling (Linden, Stone & Shertzer, 1965). 
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The average reliability coefficient reported for the CEI is .72 (Hasse 
& Miller, 1968). In addition to face validity, the CEL has discrimi- 
nitive validity with respect to counsellor's practicum grades at or 
beyond the .05 level of significance (Linden, Stone & Shertzer, 1965). 
A factor analysis of the instrument yielded three principle factors: 
Counsellor Comfort, Counselling Climate and Client Satisfaction (Lin- 
den, Stone & Shertzer, 1965). 

The Counselling Evaluation Inventory has been found to be related 
to counsellor effectiveness as measured by positive changes in the 
grade point average of their clients (Rickabaugh, Heaps & Finely, 1972) 
and to the level of counsellor experience (Ivey, Miller & Gabbert, 
1968; Reed, 1969). 

The questions on this scale were answered in sequences: Always, 
Often, Sometimes, Rarely and Never. These items were rated on a scale 
one through five from least desirable to most desirable. 

Content. Each interview was rated for content (see Appendix F). 
The content ratings were designed to provide a broad framework within 
which the relevance of the tape-judged scales to this study could be 
evaluated. The judges were the same ones who rated the confrontation 
scale. Raters were instructed to reach agreement on the most frequen- 


tly occurring content theme for each segment. 


Design 


Two basic designs were employed: a 2 X 4 factorial and a repeated 


measures design. The Counselling Evaluation Inventory ratings, con- 


frontation scores and interview length were assessed using a 2 X 4 


factorial design with four counsellors operating under evaluative and 
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nonevaluative conditions. A 2 x 4X 3 repeated measures design was 
used to assess the effects of empathy and self-exploration. Three seg- 
ments, one each form the beginning, middle and end of the evaluative 
and nonevaluate counselling sessions of the four counsellors were 
compared. The level of statistical significance was set at .05. 
Hypotheses 

It was predicted that the means for the nonevaluative treatment 
would be higher than the means for the evaluative treatment on the fol- 
lowing scles. Four hypotheses were tested and a probability level of 
.0O5 was set for acceptance of these hypotheses. 

Hypothesis I: Empathy scores as measured by The Empathic Under- 
standing in Interpersonal Process: A Scale for Measurement (Carkhuff, 
1969; see Appendix A) would be higher under the nonevaluative than 
under the evaluative treatment. 

Hypothesis II: Client Satisfaction scores, as measured by the 
Counselling Evaluation Inventory (see Appendix D) would be higher under 
the nonevaluative than under the evaluative treatment. 

Hypothesis III: Counselling Climate scores as measured by the 
Counselling Evaluation Inventory (see Appendix D) would be higher under 
the nonevaluative than under the evaluative treatment. 

Hypothesis IV: Self-exploration scores as measured by the Helpee 
Self-exploration in Interpersonal Process: A Scale for Measurement 
(Carkhuff, 1969; see Appendix B) would be higher under the nonevaluative 


than under the evaluative treatment. 


Hypothesis V: There would be no difference in the confrontation 
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scores as measured by The Confrontation in Interpersonal Process: 
Scale for Measurement (Carkhuff, 1969; see Appendix C) between the 


evaluative and nonevaluative treatments. 
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CHAPTER LV 


RESULTS 


A summary of the Means (X), Standard Deviations (SD), Sample 
Sizes (N), and F-ratios (Ff) for the dependent variables is presented 


ine tabpie: 5, 


Counsellor Functioning 

Empathy. The means for the empathy ratings are reported in Table 
6, and the summary of the repeated measures analysis is reported in 
Table 7. A one-tailed test of the difference between the evaluative 


(X = 2.63) and nonevaluative (X = 2.65) treatments showed no signifi- 
cance. 

In sum, Hypothesis I was not accepted. 

Confrontation. The means for the confrontation scale are reported 
in Table 8, dnd a summary of the analysis of variance is presented in 
Table 9. A two~tailed test between the evaluative es = 2.23) and non- 


evaluative (Xx = 2.47) treatments found no significant difference. 


In sum, Hypothesis V was not rejected. 


Client Functioning 

Client Satisfaction Factor (CEI). The means for the Client Sat~ 
isfaction factor of the Counselling Evaluation Inventory are presented 
in Table 10, and the summary of the analysis of variance is presented 
in Table 11. For all counsellors the means for the nonevaluative 
treatment as opposed to the evaluative treatment were higher. A one- 
tailed test of the difference between the Evaluation Treatment Mean 


(X = 27.04) and the Nonevaluation Treatment Mean € = 29.26) was sig- 
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TABLE 5 


SUMMARY OF THE MEANS, STANDARD DEVIATIONS, SAMPLE SIZES, 
AND F-RATIOS FOR THE DEPENDENT VARIABLES BY TREATMENTS 
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TABLE 6 


MEAN EMPATHY SCORES 
FOR COUNSELLORS BY TREATMENTS 


Coun~ Coun Coun- Coun- 
Treatment nm oociior 1 on “sellor 2° n “sentor 5. “senior 4 
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Nonevaluation 7 2.97 10 2.42 10 Dato 11 ZOS6 
Total 14 PARTS) 24 2.49 P25b 2267 29 2203 
TABLE 7 
SUMMARY OF REPEATED MEASURES 
ANALYSIS OF EMPATHY SCORES 
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TABLE 8 


MEAN CONFRONTATION SCORES 
FOR COUNSELLOR BY TREATMENTS 
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TABLE 9 


SUMMARY OF ANALYSIS OF VARIANCE 
OF CONFRONTATION SCORES 
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TABLE 10 


MEAN CLIENT SATISFACTION 
SCORES FOR COUNSELLORS BY TREATMENTS 
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TABLE 11 


SUMMARY OF ANALYSIS OF VARIANCE 
FOR THE CLIENT SATISFACTION FACTOR 
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Source DF MS F P 
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TABLE 12 


MEAN COUNSELLING CLIMATE 
SCORES FOR COUNSELLORS BY TREATMENTS 


Coun Coun- Coun- Coun- 
Treatment nm sellor 1 m -selfor 2. m sselfor osm sellor 4 
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Nonevaluation 6 41.6 2 41.9 a: 4299 184 Oe 
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SUMMARY OF ANALYSIS OF VARIANCE 
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TABLE 14 


MEAN DEPTH OF SELF~EXPLORATION 
SCORES FOR COUNSELLORS BY TREATMENTS 
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TABLE 15 


SUMMARY OF REPEATED MEASURES ANALYSIS OF 
DEPTH OF SELF~EXPLORATION SCORES 
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nificant at the .05 level. 

In sum, Hypothesis If was accepted. 

Counselling Climate (CEI). The means for the Counselling Climate 
factor of the Counselling Evaluation Inventory are reported in Table 
12, and the summary for the analysis of variance is presented in Table 
13. A one-tailed test of the difference between the means for the 
evaluative (X = 41.7) and nonevaluative (z = 41.5) treatments was not 
significant. 

In sum, Hypothesis III was not accepted. 

Depth of Self-Exploration. The means for the client's depth of 
self-exploration scale are reported in Table 14 and the summary of the 
repeated measures analysis is presented in Table 15. The scores re- 
ported in Table 14 were lower than expected. A one-tailed test of the 
difference between the means for the evaluative és = 1.82) and non- 
evaluative (x = 1.69) treatments was not significant. 


In sum, Hypothesis IV was not accepted. 


Additional Findings 

Counsellor variables. On the empathy and confrontation scales 
(Tables 7 & 9) the Counsellor Main Effect was significant at the .01 
level. Thus, there were differences in the average apne te and confron- 


tation scores among the counsellors. On these scales the means for the 


counsellors fluctuated across treatments. That is, some of the coun- 
sellors offered higher levels of these conditions under the evaluative 
treatment, while other counsellors offered higher levels of these con- 
ditions under the nonevaluative treatment. The interaction effects 


for both scales reflect this trend as they approach significance (p = 06). 
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Client variables. The scores for each of the 21 questions on the 
Counselling Evaluation Inventory (CEI) were doupnveus haane 2A ore 
analysis of variance designs. Only on Question 13 ("I felt comfortabie 
in my interview with the counsellor.") was a significant difference 
between the evaluative and nonevaluative conditions detected (emer uils 


see Appendix H). 


In brief, evaluation and nonevaluation had very little effect on 
the tape~judged scales of empathy, confrontation, and self-exploration 
and on the clients’ ratings on the Counselling Climate Factor of the 
Counselling Evaluation Inventory. The data, however, seemed to support 
the conclusion that clients felt more satisfied with the nonevaluative 
rather than the evaluative treatment. The fluctuation of counsellors 
across treatments on the empathy and confrontation scales suggests 
that there is no simple straightforward relationship between counsellor 


functioning and the evaluation-nonevaluation dichotomy. 
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CHAPTER V 


DISCUSSION 


On the tape-~judged scales there was no support for the client- 
centered or nonevaluation position. The predicted negative effects of 
evaluation on the relative levels of empathic understanding offered to 
the two treatment groups did not materialize. Moreover, evaluation 
relative to nonevaluation did not significantly effect the client's 
depth of self-exploration. 

On the other hand, the clients' ratings seemed to indicate that 
evaluation in comparison to nonevaluation can reduce client satisfac- 
tion and/or feelings of comfort. However, with respect to ratings of 


counselling climate there was no difference between treatments. 


Design. There were several uncontrolled factors that could have 
affected the results of this study. This experiment was originally 
designed as a 2 X 2 analysis of variance. However, factors beyond the 
experimenter's control caused a fluctuation of sample sizes across 
treatments and counsellors, and a reduction in the overall N. These 
factors included the vacation schedules of counsellors during critical 
periods and a reduction in the number of faculties in the study from 
five to three. Many of the $s and potential Ss were improperly iden- 
tified by the office staff. This often caused a last-minute assignment 
to the project or the failure of a candidate to be included in the 
sample. Most of the potential Ss, who were identified after completing 


testing, were assigned to the evaluation treatment, because they had 
> 


been informed by the office staff that they would be evaluated. The 
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project was extended for a year, because of a low N in 1973. The re- 
sult of the extension was a 2 xX 4 analysis of variance with Ss nested 
within Counsellor pairs 1-2 and 3-4. Subjects, thus, did not have the 
opportunity to be randomly assigned to all counsellors and uncontrolled 
sources of error resulted. 

Experience of counsellors. The four counsellors were relatively 
inexperienced (a newly appointed staff member and counselling interns) 
in comparison to the other members of the counselling staff. The lack 
of training and experience in working with the tests could have pro- 
duced a climate of uncertainty. If uncertainty was a by-product of in- 
experience, this may have lowered the levels of counsellor functioning 
and affected their predictions. It seems likely that it might have 
been safer to recommend all Ss rather than take a chance of closing the 
door on a client's academic future. This would have been congruent 
with the humanistic attitudes of all the counsellors. 

In contrast to the levels of empathy reported in the literature 
it should be noted that in this study the counsellor with the lowest 
Total Mean (2.49) was functioning at a relatively high level. For ex- 
ample, Carkhuff and Berenson (1967) reported that the average mean for 
the empathy scale for 32 (experienced) counsellors was 1.86. Kurtz 
and Grummon (1972) reported an average score of 2.26 for -31 counsel=— 
lors, clinical psychologists and interns with) Frome 20 years “exper= 
While uncontrolled rater characteristics make comparisons be- 


ience. 


tween studies difficult, the measured functioning of counsellors on 


the empathy scale suggests that counsellors in this study were at least 


average. 


1 1 Peed 
Data collection. Steps were not taken to ensure the confidenti 
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ality and/or security of the answer sheets for the Counselling Evalu- 
ation Inventory. Thus, Ss may have justifiably assumed that the coun- 
sellors would have access to their ratings. It seems likely that this 
perception could have led to an elevated appraisal of counselling. In 
this regard, it should be noted that the ratings in both treatments 
were high, i.e., they averaged about four on a five-point scale. In 
the evaluative treatment, where the Ss were aware that the counsellor's 
recommendation was incomplete, the climate would have been particularly 


ripe for them to soften or not express any negative feelings. 


Counsellor Functioning 

The Total Treatment Means for the empathy and ia otipel peal eny 
revealed a difference between the counsellors’ levels of functioning. 
This finding was not surprising, since it has been consistently re= 
‘ported in the literature that counsellors differ with respect to levels 
of functioning (e.g., Truax & Carkhuff, 1967). That is, some counsel- 
lors operate at high levels, while others seem to function at low 
levels. 

Rogers (1975) has stated that true empathy is always free of an 
evaluative component. Kell and Mueller (1966) have suggested that the 
quality of the relationship between counsellor and client is inversely 
related to the diagnostic stance of the counsellor. Moreover, it was 
the author's concern that the potential conflict between service to 
both institution and client would detract from the counsellor's effec- 
tiveness. There was no support for these ideas. 

It is possible that the treatment conditions may not have appre- 


ciably influenced the overall levels of counsellor functioning. How- 
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ever, since there was only one negative recommendation in the evalua- 
tive treatment, it also seems likely that most or possibly all of the 
counsellors could have taken a nonevaluative approach to both treat- 
ment conditions. Thus, the hypothetical gap between the two treatments 
might have been minimized. 

The evaluative and nonevaluative conditions appear to have had 
some effect on the functioning of the counsellors, because the levels 
of empathy and confrontation seemed to vary across treatments. For 
Counsellors 1 and 2, the performance patterns were consistent for both 
variables. Counsellor 1 functioned at a higher level in the nonevalu- 
ative than in the evaluative treatment. The reverse was true for 
Counsellor 2. There was inconsistency with respect to the patterns of 
empathy and confrontation for Counsellors 3 and 4. Counsellor 3 of- 
fered higher levels of empathy to Ss in the evaluative treatment than 
to Ss in the nonevaluative treatment. For confrontation the pattern 
was reversed (evaluation < nonevaluation). For Counsellor 4 the exact 
opposite pattern with respect to these variables was found. 

The variation of counsellors across treatments on the confronta- 
tion and empathy variables were very much in line with the findings of 
Brown and Calia (1968). In their study two counsellors reported feel- 
ing "shame and guilt" during compulsory interviews but positive feel- 
ings towards client-initiated contacts (p. 405). On the other hand, 
another counsellor reported reacting more favourably toward the compul- 
sory interviews. Brown and Calia (1968) suggested that counsellor bias 
rather than client behavior may have more of an impact on the initial 
interview. 


In this regard, an informal survey of the counsellors in this 
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study revealed a preference for client-initiated interviews. With re- 
spect to the treatment conditions Counsellors 1, 3, and 4 were more 
positive about nonevaluation rather than evaluation. On the other 
hand, Counsellor 2 preferred evaluation. The performance of Counsel- 
lors 1 and 2 were consistent with their reported reactions to the treat- 
ment, but the performances of Counsellors 3 and 4 were inconsistent. 
With respect to the client's perception of the counsellor's performance 
on the Counsellor Comfort Factor of tHe Counselling Evaluation Inven- 
tory neither Treatment nor Counsellor X Treatment effects were signif- 
icant (see Appendix G). Thus, the effects of evaluation and nonevalu- 
ation appear to be mediated by counsellors, and counsellor idiosyncra- 
cies or biases seem to be as important as the treatments. 

It seems reasonably clear that counsellors offered substantial 
levels of empathy within the evaluative treatment. The question as to 
whether or not their behavior was caused by a nonevaluative approach 
to evaluation is both relevant and unanswerable. However, within the 
study imposed institutional evaluation did not present an insurmount~ 
able hurdle in the way of empathic understanding. Im fact, for Coun- 
sellors 2 and 4 the average level of empathy was higher in the evalu-~ 
ative rather than the nonevaluative treatment. The client depth of 
self~exploration means showed the same pattern. In addition, the cor- 
relations between empathy and self~exploration reported in Table 19 
(see Appendix I were positive and the relationships between Empathy qT, 
(the second sequence) and Self-exploration T, and Empathy T. (the third 
sequence) and Self~exploration T, were significant at the .05 level. 
Since confrontation has been positively associated with client depth 


of self-exploration, it should be noted that the correlations between 
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these two variables on the same sequences reported above (Table 19; 

see Appendix I) were either negligible or negative. Thus, there was 
evidence to suggest that counsellors can establish rapport and possibly 
facilitate client growth within the framework of institutional evalu- 
ation and the required counselling interview. Moreover, there was no 
support for the client-centered tenant that evaluation per se is harm- 
ful to the establishment of facilitative interpersonal relationships. 
Finally, the highly speculative correlational data appear to indicate 
that within the context of the required counselling interview empathic 
understanding rather than confrontation might be more a therapeutic 


approach. 


Client functioning 

While there were nonsignificant differences with respect to the 
means of counsellors across treatments for empathy and confrontation, 
the clients’ reported feelings of satisfaction did not show the same 
fluctuation. That is, the differences in the relative satisfaction 
levels reported by clients appear to be a function of the treatment con- 
ditions per se and did not appear to be counsellor~-mediated. On the 
other hand, ratings of counselling climate were unrelated to the eval- 
uative treatments and counsellor functioning. 

Thus, there was some support for the nonevaluation--client-cen- 
tered position that evaluation, rather than nonevaluation, would re- 
duce feelings of comfort and satisfaction. However, the support is 
qualified, because the ratings of clients for both treatments were gen- 


erally positive, even the client satisfaction scores. Therefore, it 


is possible that evaluation may only be a minor irritant and not a 
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major obstacle in the path of counsellor-client rapport. The highly 
Speculative correlational data cited above also support this sugges- 
tion, but the effects, extent, or depth of client's dissatisfaction or 
apprehension experienced as a consequence of evaluation can only be a 
topic for speculation and cannot be determined from the data. 

In the client-centered position evaluation and threat are usually 
seen as synonymous (Patterson, 1971). Therefore, it was expected that 
clients would feel freer to express their emotions in the nonevalua-~ 


tive than in the evaluative treatment. There was no support for this 


2 


hypothesis. In the light of the overall positive reactions towards both 


treatments, and the difference between treatments with respect to rated 


feelings of comfort and satisfaction, the fact that most clients did 
not apparently explore their feelings, especially in nonevaluation in- 
terviews, was totally unexpected. 

It should be kept in mind that client-ratings were probably ele- 
vated because clients were not told that their ratings would be kept 
confidential. However, there were other factors which could have ac= 
counted for discrepancies between client-ratings and interview behav- 
ior. In spite of all the precautions taken to inform Ss in the non- 
evaluative group that they would be making their own decisions about 
returning to university, many Ss seemed to feel that there would be 
"strings attached" to this condition. It was noted by the author that 
questions during the initial phase of the interviews appeared to re- 
flect the Ss' apprehension about what was "really" going to happen to 


them Thus, it seems likely that many Ss in the nonevaluative group 


did not trust the information they received, and as a result they could 


have stifled their participation. 
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In addition, the depth of self-exploration scale did not appear 
to be particularly relevant to the interview. In therapy the client's 
emotional responsiveness is crucial. However, in the situation under 
Study other factors would seem to be more relevant, such as long-range 
goals, tendencies towards procrastination, problems within the family, 
study habits, etc. There may have been an emotional component wrapped 
up in all of these phenomena, but in most of the rated segments the 
counsellors' probings did not appear to be directed towards this com 
ponent. In fact, only about 30 percent of the segments were rated as 
personal. 

Arbuckle (1965) and Grummon (1965) have suggested that self-refer- 
ral is a necessary precondition for effective counselling. Therefore, 
it is also possible that the low depth of self-exploration scores in 
both treatments may reflect a lack of client readiness or a defensive 
predisposition towards required counselling. 

Finally, it was noted above that counsellor experience, biases, 
and training may have affected rapport. All of the counsellors in- 
formally reported experiencing a moderate amount of stress and dislike 
for the required interview--whether evaluative or nonevaluative. All 
of the counsellors preferred working with self-referred clients. It 
has been suggested that counselling reluctant clients, as many of the 
Ss in this study appeared to present themselves, seems to involve a 


somewhat different approach and/or different skills than working with 


clients who voluntarily seek help (Calia, 1966). In this study coun- 


sellor experience, supervision, and training may not have been ade- 


quate to overcome counsellor biases towards the required interviews, 


and low client self-exploration may be a by-product of one or all of 
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57 
these conditions. 


Evaluation and nonevaluation have been viewed as basic tensions 
within man (Stott, 1973). These tensions reflect a polarization of 
viewpoints within the profession. However, an empirical examination 
of these issues within counselling did not produce a one-to-one cor- 
respondence with counsellor functioning or client depth of self-explor- 
ation. The two poles did seem to coincide with clients’ reported feel~ 
ings of satisfaction with evaluation receiving the lower rating. 

If client comfort and satisfaction as measured by the Counselling 
Evaluation Inventory are considered to be primary goals of counselling, 
and this is not the author's position, then nonevaluation rather than 
evaluation would seem to be a more acceptable alternative. However, 
the effects of evaluation will ultimately be considered within the 
framework of institutional decision-making and gains and losses to both 
the institution and the client should be analyzed (Cronbach & Glesser, 
1965). In this regard, client comfort and satisfaction are seen as 
only one piece of the puzzle. 

In this study the single significant finding should be viewed in 
relation to other less statistically prominent data, such as the low 
client self-exploration scores in the evaluative and nonevaluative 
treatments, counsellor variability across treatments on the confronta- 
tion and empathy scales, and the clients' generally positive ratings 


for both treatments. In addition, it should be noted that methodol- 


ogical problems cast a shadow over all of the findings. 


As noted above, the overall positive ratings for the client sat- 


isfaction and counselling climate scores in the evaluative and non- 
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evaluative treatments might have been attributable to safeguards that 
appeared to be inadequate to ensure the confidentiality of clients' 
answer sheets. These ratings may also reflect positive attitudes on 
the part of clients to both treatments. 

Within the client-centered tradition it has been assumed that the 
absence of threat in the form of evaluation would positively affect 
both the clients’ ratings and depth of self-exploration. Rogers (1957; 
1975) has stated that self-exploration is a critical component in the 
therapeutic process. An absence of treatment effects on this variable, 
when considered with the fairly positive client reactions towards the 
interviews, raise questions as to the ultimate effect of evaluation on 
client functioning and consequently counsellor-client rapport. That 
is, does evaluation reduce satisfaction to the extent of blocking or 
impeding rapport, or does the client's rated dissatisfaction with the 
Ree ee treatment represent only a minor irritation or mild situa- 
tional stress? Unfortunately, these questions cannot be answered by 
the data collected for this study. 

Low client depth of self-exploration in both treatments seems to 
indicate that the behavior of clients was detached, guarded, and/or 
mechanical. Several of the raters described the clients' behavior as 
superficial, and the author who listened to all of the sessions, most 
of them in their entirety, would agree with these observations. While 
this evidence can hardly be considered conclusive, it seems to be suf- 
ficient to question the value of these interviews to the clients. 

As noted above, low client self-exploration might simply be a pro- 
duct of required counselling (Arbuckle, 1965); however, the results of 


the Brown and Calia (1968) study seem to indicate that counsellor func- 
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tioning was the critical ingredient in initial, required interviews. 
It is the author's hypothesis that counsellors in this study adopted 
the same approach (mostly reflective and/or empathic) to required, 
evaluative interviews as they employed in self-referred personal and 
vocational counselling. Calia (1966) has suggested that required and 
client-initiated counselling situations demand different approaches 
and/or skills. Therefore, the low self-exploration scores might be 
attributable to counsellor functioning. 

If within a required counselling or an evaluative setting special 
skills and/or behaviors are necessary for effective counselling (Calia, 
1966), then from an educational and administrative perspective precau- 
tions should be taken to ensure that junior staff members and other 
trainees (students) receive adequate training and supervision in these 
areas. The effects of counsellor training on their subsequent perfor- 
mance in required or evaluative settings would seem to be a fruitful 
area for future research. It should be noted that the implications of 
such research would not be confined to the setting in this study. 
Tyler (1963) suggested that required counselling might be the most ap- 
propriate method of initiating contacts with minority groups and stu- 
dents from deprived environments. She notes that these people often 
need professional help but do not generally seek it. 

In this study counsellor training, experience, and biases appeared 
to be ti dm, arene evaluation and required counselling. The vari- 
ability of the counsellor-offered conditions of empathy and confronta- 


tion across treatments seems to add further weight to the suggestion 


that counsellors are the fulcrum that will determine the effectiveness 


of institutional programs. In this light, it would be interesting to 
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compare two matched groups of high functioning, experienced counsel- 
lors: one pro-evaluation, the other anti-evaluation, within an evalu- 
ative and nonevaluative setting. 

In the literature on counselling there are many testaments con- 
cerning the relative effectiveness of one counsellor or group of coun- 
sellors as compared to another counsellor and/or process. However, 
from an institutional perspective the counsellor as a mediating vari- 
able has received very little attention. There have been discussions 
about required versus self~initiated interviews, evaluation versus 
nonevaluation and testing versus no measurement. Counsellor compli- 
ance has been more or less assumed or not considered in detail. These 
findings, added to the work of Brown and Calia (1968) seem to suggest 
that the counsellor as a mediating variable may be as important or more 
important than the institutional conditions imposed upon counselling. 
Thus, evaluation and nonevaluation seem to be important issues within 
and between counsellors, but there is reason to question the importance 
of these constructs without examining counsellor mediation at the same 
time. 

If counselling idiosyncrasies are considered along With 2nstitu- 
tional conditions, then complexity is added to the task of the research- 
er, counselling educationalist and administrator. It seems clear that 
the good-bad, black-white positions on evaluation and nonevaluation 
need to be focused with respect to institutional, client, and counsel- 


lor variables, and that the latter seems to be pivotal. A few tenta- 


tive steps in this direction have been taken (Brown & Calia, 1968; 


Mann, 1971)—-more should follow. 
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APPENDIX A 


Empathy Scale 


Level I 


The verbal and behavioral expressions of the first person either 
do not attend to or detract significantly from the-verbal and behavidral ex- 
pressions of the second person (s) in that they communicate significantly 
less of the second person's feelings than the second person has communicated 
himself, 


Level 2 


While the first person responds to the expressed feelings of the 
second person (s), he does so in such a way that he subtracts noticeable 
affect from the communications of the second person. 


Level 3 


The expressions of the first person in response to the expressed 
feelings of the second person (s) are essentially interchangeable with those 
of the second person in that they express essentially the same affect and 
Meaning. 


Level 4 


The responses of the first person add noticeably to the express- 
ions of the second person (s) in such a way as to express feelings a level 
deeper than the second person was able to express himself. 


Level 5 


The first person's responses add significantly to the feeling 
and meaning of the expressions of the second person (s) in such a way as 
to (1) accurately express feelings levels below what the person himself was 
able to express or (2) in the event of on going deep self-exploration on 
the second person's part to be fully with him in his deepest moments. 
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APPENDIX B 


Depth of Self-Exploration 


Level 1 


The second person does not discuss personally relevant material, 
either because he has had no opportunity to do such or because he is actively 
evading the discussion even when it is introduced by the first person. 


Level 2 


The second person responds with discussion to the introduction 
of personally relevant material by the first person but does so in a mechan- 
ical manner and without the demonstration of emotional feelings. 


Level 3 


i 


The second person voluntarily introduces discussions of personally 
relevant material but does so in a mechanical manner and without the demon- 
stration of emotional feeling. 


Level 4 


The second person voluntarily introduces discussions of personally 
relevant material with both spontaneity and emotional proximity. 


Level 5 


The second person actively and spontaneously engages in an inward 
probing to discover new feelings and experiences about himself and his world. 
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Confrontation 


Level 1 


The verbal and behavioral expressions of the helper disregard the 
discrepancies in the helpee's behavior (ideal versus real self, insight ver- 
sus action, helper versus helpee's experiences). 


Level 2 

The verbal and behavioral expressions of the helper disregard the 
discrepancies in the helpee's behavior. 
Level 3 


The verbal and behavioral expressions of the helper, while open 
to discrepancies in the helpee's behavior, do not relate directly and spec- 
ifically to these discrepancies. 


Level 4 


The verbal and behavioral expressions of the helper attend directly 
and specifically to the discrepancies in the helpee's behavior. 


Level 5 


The verbal and behavioral expressions of the helper are keenly 
and continually attuned to the discrepancies in the helpee's behavior. 
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APPENDIX p 70 
COUNSELLING EVALUATION INVENTORY 


I distrusted the counsellor. 


The 


counsellor gave the impression of "feeling at ease". 


I felt the counsellor accepted me as an individual. 


I felt at ease with the counsellor. 


The 


counsellor helped me to see how taking tests would be helpful to me. 


In opening our conversations, the counsellor was relaxed and at ease. 


The 


counsellor acted as if he had a job to do and didn't care how he 


accomplished it. 


The 


The 


The 


The 


The 


counsellor acted uncertain of himself. 

counsellor acted cold and distant. 

counsellor was very patient. 

counsellor was awkward in starting our interviews. 


counsellor's comments helped me to see more clearly what I need to do 


to gain my objectives in life. 


I felt comfortable in my interviews with the counsellor. 


The 


The 


The 


The 


counsellor seemed restless while talking to me. 
counsellor's discussion of test results was helpful to me. 
counsellor insisted on being right always. 


counsellor acted as though he thought my concerns and problems were 


important to him. 


Other students could be helped by talking with counsellors. 


I believe the counsellor had a genuine desire to be of service to me. 


In our talks, the counsellor acted as if he were better than I. 


I felt satisfied as a result of my talks with the counsellor. 


Counselling Climate 


Items are answered according t 


kk Client Satisfaction *k* Counsellor Comfort 


o the following categories: 


Always, Often, Sometimes, Rarely, Never. 
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APPENDIX E 


Dear 


For this Summer only, the Student Counselling Services has 
obtained permission from three of the Faculties to evaluate various methods 
of obtaining re-admission by those who have been absent from the University 
for at least a year, and who are now seeking re-admission. 


You, along with other selected students, will have an opportunity 
to take psychological tests in the ordinary way, but, while a Counsellor 
will see you and will discuss your plans with you, as well as the possible 
meaning of the psychological tests, the decision will remain with you to de- 
cide whether or not you will seek re-admission. While your application must 
subsequently be approved by the Dean of the Faculty to which you seek re-ad= - 
mission, ordinarily your decision will be honored, unless there is some 
factor that is not currently known to us; for example, if you have twice been 
required to withdraw from the University, or if you should lack some matric- 
ulation subject which is essential for the Faculty to which you are applying. 


However, you should understand that the policies concerning those 
who are re-admitted after being required to withdraw will apply. In short, 
in the next session you must pass all subjects and must achieve an average of 
not less than 5.0. 


Should you prefer not to be in what is essentially an experimental 
procedure, for it has not hitherto been tried at this University, you are free 
to so indicate. In that event, you will take the tests that are usually given, 
will be interviewed by a Counsellor, and the Counsellor will subsequently make 
a recommendation to the Dean. The essential difference is that in the ex- 
perimental group to which you have been assigned, the Counsellor will not make 
a recommendation to the Dean. The fact that you choose not to be a part of the 
experimental group will not prejudice the appraisal made by the Counsellor who 


sees you. 


It would be helpful if you would tell us whether you wish to be 
evaluated by a counsellor. Your silence on this matter will indicate to us 
that you wish to make this decision without a counsellor's recommendation. 


Yours sincerely, 
aa 


A.J.B. Hough 


ge Director. 
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APPENDIX F 


Vocational: 


Content centering around life's goals, vocational and 
faculty choice will be scored here. Most of the conversations about 
vocational interest tests will also be scored here. For example: 


"The test suggests that you would like to work 
with people." 


"Your interests seem to coincide with those in 
business." 


Discussions of how much money a student would make; 
or how she or he would feel about "shyness" in relation to standing in 
front of a class or merchandising would be appropriately coded Vocat- 
ional. Faculty choice themes are put under this heading rather than 
Educational. If the central issue is what went on in the past-in Faculty 
X, then the item should be scored Educational. However, if the orienta- 
tion is towards the future (I think I would be better off in X than Y), 
then it should be scored here. 


Administrative: 


Dialogue in which the majority of conversation refers to the procedures 
for readmission and/or course selection will be scored under this heading. 


Content themes will include the following: "Who do I see about courses?" 
"How long before I hear from the Dean?" "When will I know if I am accepted?" 
"Counsellors only make recommendations - the rest is up to the Dean." "I 


Wild write a letter..." 


This category differs from the one labelled Scholastic in that it does 
not focus on past difficulties or problems anticipated with respect to 
academic performance. Instead, the focus is on the mechanics of getting into 
university, selecting courses, or explaining the special conditions under 
which the S is being interviewed, etc. 


Bducational: 


Academic effectiveness is the main characteristic of items placed here. 
Themes, such as how things will be different this time or Hae pears 
last time, how to study effectively, etc. ace a included under this ru Fic. 
For example, "I won't take a part-time job. oes away from the noise at 
home will sure improve my ability to concentrate. No more bar this time 
around." "The test results suggest that you would have wouter yy ah! with 
report writing, because your vocabulary seems to be sagen in sum, various 
approaches to increasing effectiveness or Fev ew ene what went wrong are 
the critical elements in assigning a segment to this category. 
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APPENDIX F (Cont'd) 


“eae 


Testing: 


Discussions about the tests per se, such as the usefulness of tests, 
why do I have to take them, etc. are coded under this heading. Not in- 
cluded in this category will be dialogues concerning the client's person- 
ality or vocational interests based on the test material. For example, if 
a counsellor tells a client that the test results suggest he is passive and 
the resulting discussion centers around his feelings about the counsellor's 
statement, then the sequence would be scored Personal and not Testing. How- 
ever, if the aforementioned statement led to a discussion of the validity 
of the CPI, then it would be scored in this category. Themes such as "Why 
are all these tests American?" "How can you tell anything from those crazy 
true and false questions?" are scored Testing. 


Personal: 


When the focus is on the integrity, feelings, what's happening in 
the here and now between counsellor and client, personality and/or overall 
adjustment of the client then the sequence should be recorded here. For 


example, "How do you feel about yourself?" "You seem to be pretty uncom- 
fortable with what’ just said." "I have a lot of trouble meeting new 
people, especially boys." There will be a great deal of overlap between this 


category and all of the others with the possible exception of chit-chat. If 
the dialogue refers to a or behavior pattern that keeps the client away from 
the library, then the sequence is scored Educational not Personal. However, 
if placed in the context of life in general, then it belongs in this cate- 


Borys 
Chit-Chat: 
Idle conversation about hockey, the weather, do you know kX from Cal- 


gary etc. will be coded here. 


N/A (Not Applicable) - give a one or two word description. 
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APPENDIX G 
Table 16 
SUMMARY OF ANALYSIS OF 


VARIANCE FOR THE COUNSELLOR 
COMFORT FACTOR 


Source DF M F P 
A (Treatments) 1 TONGS 2-16 14 
B (Counsellors) 3 44,11 34 As: 
Ax B 3 Z0no0 .63 .60 
Error 78 oi. OO 
Table 17 


MEAN EMPATHY, DEPTH OF SELF-EXPLORATION 
AND CONFRONTATION SCORES FROM ‘THE BEGINNING, 
MIDDLE AND END OF INTERVIEWS 


Scale Beginning (T)) Middle (T.) End (T;) 
Empathy oe oul ae 
Self-Exploration Bea: ey, ue 
Confrontation 2.4 2.4 : 


We 


i me 4) in 
eee 


ay 7a . oe zu 


igs wa A vi 
re “ 7: rigs 


7 - “uy 


f 


Source 


A (Treatments) 
B (Counsellors) 
A XB 

Recor 


APPENDIX H 
Table 18 


SUMMARY OF ANALYSIS OF 
VARIANCE FOR QUESTION THIRTEEN 
OF THE COUNSELLING EVALUATION INVENTORY 


Ane a nN 


DF MS 
i 8.4 
3 29 
5 

67 


10 


708 


“ATQe2epTsuod seTieA [Ted rod N ey. sexoos uoTZeEQUOAsUOD Aog™ :990N 


co°7 d x 

OsaT es uoTIeqUuoaATUoO “LL 
00° Ort ey UOTIeAUOAZUOD OT 
Se cee ar Ty uotaequoijuop 6 °¢ 
Og ee cI 6 Oat sy uotiexotdxg-JTeg +g 
Pit erees Oe 1800 =2 22920 O°T Cy uopqeaoTdxy-stes */ 
Gromer SUS ace ee." O°T Ty wopaeszotdxg-3tes *9 
Ope: GT°- SO°- 09° 6T° €0° OR ©. Ayaedug -c 
fic = 20° 10°. 60°" %le*  “-E0°-- ¥0E° pat Cy Ayjedmg +4 
a ST 10" 80" ET gor cee ot Th kyyedmg +e 
Gina emi 0 = HCL Le EO" ROY ier are O°T yySue] metarequy «+z 
CeO Tiare 80". PUP = of — EO 0 ee = et (Tao 6 aay 


SHIGVIAVA LNSGNHdad GHLOWIES 
NASMLAA SNOLIVIATEOO 
SHL £0 AYVYAWNS V 


6L 2PTSPL 


XIGNEddV 


OT 
ag { " 4 : 
i ‘ | ; } 
| , . ‘ vie | ei 
va ' ay i : | ’ i 7 
if ey 
ae | Wee ee ey et 
gat ae as ue a) ee 
‘ we ED, cars 
i” ; Pope Vik ; “i 
P. che o \ wid 
' ‘aaa 1 
| Ay i wi 
<"T bery! , ‘S 7 
. ‘ : Se we a | 
i i] 
> ns A 
: ly ti f S 
» Te 1 


j 
t ~ 
fe, é 7 
’ jos 
og ‘ 
‘ 
{ 
; 
: 
ae 
¥ t 
¢ jr ’ ‘ 
: i] 
i 
: < 
ps ial} ry 
cs an 
h~, » , 
- i. 
# 


*4 


ae 


HIVETES - 


1 
a ts (ae | Se 
: \ . ‘ i er lew «<t ee 
os : 3 By! et 


iT 
: 


ZA 


e 
aHps 
i 


ONES Gb 


? } f ¢ ; 
hi AY r eg ic te rue 
ney To i 
as rT i) Su } ¥ 
im} ) f j { - mo 
; i 
be ba ore | ie 
ae } 


=—— 


Shen- ips 


sr Soe 
—_s 


— as 
——— 
a 
_ 
Eaee 
Fe. 
—, 
- a7, ” 
pie kee * 
ws = 
[Oto = 
— 
: 
_ 
as 


Lom 
az J 


asks 


eek as ie 
pie! Hh WLAN} 


¥ ‘ h 


‘ F j a 
\ Ve . : ie VY aa 
wa vi Rees, 
8, Vey Thee | Bea it! nr 
ht ; ales! pie he ; oi “a 


pi tae ee ae 6 ne Thad 
, a a ; : ‘ \y ; ‘ 7 ea es 
tet " u ay) & hr i 


{ 
i ee 
m fF) it J 
of = ; 
i re 
Yi] AS 
ri? 
i 4 im 
4 
‘ 
f 7 
1 d 
‘ 
iy 5 
~~? 6 
m., t 
b i 
Ay 
J at 
Vt ii 
\ } ; / 
\ eo} 
tf q 
2 Vy 
* 
( 
z 
+ 


5 
é Ba 
& 
% ; i 
ie yi! 
al 
4 
1 
+, "] 
Ht 
i £4 
hy 
eee 
\ 4 
4 aM y tore 
oa nq 
: : oy 
\ i "i 
i r% ; 
: " 
" 
( 
54 
A” 


te 


1 


PS, | 


— 


4 

mF 
r 
1) 


